System and Method for Integrating an Electronic Pointing Device into Digital Image Data

ABSTRACT

A method and system is provided for creating an integrated video stream based on relative location and movement of a wireless pointing device. The system includes a receiver for continuously receiving position data from a wireless pointing device and a processor for calculating an initial position and orientation of the wireless pointing device based on the position data received from the wireless pointing device, accessing additional data from a secondary source based on input data received from the wireless pointing device, and creating the integrated video stream based on an original video stream, the initial position and orientation of the wireless pointing device and the additional data accessed from the secondary source. The system further includes a server for transmitting the integrated video stream to the wireless pointing device to be rendered on a screen thereof.

CROSS REFERENCE TO RELATED APPLICATION

This application is a continuation of U.S. patent application Ser. No.14/712,269, filed May 14, 2015, which is a continuation of U.S. Pat. No.9,094,707, filed Mar. 18, 2014, which is a continuation of U.S. Pat. No.8,717,289, filed on Jun. 21, 2011, which claims priority to U.S.Provisional Application No. 61/357,379, entitled System and Method forIntegrating an Electronic Pointing Device Into a Video Feed, filed onJun. 22, 2010, the contents of each of which are incorporated herein byreference into the present application.

BACKGROUND OF THE INVENTION

Commerce may be conducted in numerous venues. In particular, commercemay be conducted in real space or electronically, i.e., e-commerce.E-commerce is conducted via a computer network. Servers are used tostore product and transaction information and computer terminals areused by purchasers to access the information stored in the server toview and modify such information via a transaction.

E-commerce may also be conducted in the context of interactivetelevision. One exemplary implementation of interactive television isusing set-top boxes or the like that may be programmed for bidirectionalcommunication with a content provider. For example, a set-top box mayreceive content from a content provider and display the received contenton a television (TV) or similar such device for viewing. The developmentof interactive television has enabled companies to provide consumerswith options regarding many different products and information aboutthose products. For example, a consumer using an interactive televisionapplication, such as HSN Shop By Remote®, may often be able to browsethrough thousands of different products from the convenience of his orher own home.

Challenges with providing so much information and content to a consumerincludes the creation of a browsing and selection process that is botheasy to use and fast. While television remote controls generally providea suitable means for a user to navigate through different content andapplications, it can often be difficult moving the cursor to theappropriate location to select a given item when there are many possibleselections available at a given time. The multiple button remotes withup and down arrows can be inefficient to a user who wants to quicklynavigate through numerous selections to arrive at his or her desiredselection. Some remote controls have developed three-dimensional (“3D”)pointing techniques to alleviate these issues. For example, certainremote control devices provide 3D capabilities that enable a user tomove in three dimensions in front of a display screen. However, ingeneral, the viewing device (or a console connected to the viewingdevice) also must include specially configured hardware that enables theviewing device to receive positional data transmitted by the remotecontrol as well as unique software that can process this positional dataas desired.

SUMMARY OF THE INVENTION

Accordingly, what is needed is a system that enables remote controlpointing techniques to interact with regular viewing devices that arenot specially configured to receive and process remote control data.Thus, the system and method disclosed herein provides an integrationtechnique that combines position data from the pointing device with thedigital image content before the information is displayed on a viewingdevice. Specifically, a system and method are provided that integratesan electronic pointer into digital image data, such as a video feed orsoftware application, that is displayed on a screen. In one embodiment,the processing can be performed at a remote location. In this instance,a receiver at the remote location is provided that receives positiondata from a pointing device; a calibration unit then calculates theposition of the pointing device relative to the screen based on theposition data; and a processor then generates the electronic pointerbased on the calculated position of the pointing device. Thereafter, theelectronic pointer is integrated in the digital image data such that thevideo screen displays the electronic pointer at a location on the videoscreen that reflects the relative position of the pointing device to thevideo screen. In an alternative embodiment, the viewing device (e.g.,the video screen) can include local processing capabilities that canintegrate the digital image data, such as a video feed (e.g., standardbroadcast, DBS, cable delivered video or the like), with the electronicpointer and related content from the remote location. In one furtherrefinement, the pointing device communicates directly with the viewingdevice, which in turn communicates with the remote location.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates block diagram of a system for integrating anelectronic pointer into digital image data in accordance with anexemplary embodiment.

FIG. 2 illustrates block diagram of a system for integrating anelectronic pointer into digital image data in accordance with anexemplary embodiment.

FIG. 3 illustrates block diagram of a system for integrating anelectronic pointer into digital image data in accordance with anexemplary embodiment.

FIG. 4 illustrates a flowchart for a method for integrating anelectronic pointer into digital image data in accordance with anexemplary embodiment.

DETAILED DESCRIPTION OF THE INVENTION

The following detailed description outlines possible embodiments of theproposed system and method disclosed herein for exemplary purposes. Thesystem and method are in no way intended to be limited to any specificcombinations of hardware and software. As will be described below, theinventive system and method relate to a pointing device that enables auser to dynamically integrate a pointing indicator into a video feed orapplication or similar digital image data. The rendered pointer can beplaced on various screen locations that correspond to the user'sintended movement of the pointing device. For example, if the user movesthe pointing device in a specific direction with respect to a viewingdevice, the rendered pointer on the screen of the viewing device willmove according to the user's movement. Additional dynamic functionality(e.g., purchase an item, request information, select another videostream, play a game, etc.) can be triggered by “clicking”, hoveringover, or “selecting” a location pointed to, or by inputting additionaldata using the pointing device.

FIG. 1 illustrates a block diagram of the system 100 for integrating anelectronic pointer into a video feed. In general, system 100 is dividedinto a user location 102 and a remote processing system 104. The userlocation 102 can be considered any location in which a user of apointing device 110 is capable of viewing a video feed or application ona viewing device 120. Moreover, the remote processing system 104 can beassociated with a secondary processing system (e.g., a product supplier)and/or content provider that is capable of processing data transmittedto and from the user location 102. A general illustration of therelationship between a user location, a product supply server, i.e.,secondary processing system, and a content provider is discussed in U.S.Pat. No. 7,752,083 to Johnson et al., issued on Jul. 6, 2010, andentitled “METHOD AND SYSTEM FOR IMPROVED INTERACTIVE TELEVISIONPROCESSING,” which is hereby incorporated in its entirety by referencethereto.

As shown in FIG. 1, user location 102 includes pointing device 110 thatis configured to remotely communicate with gestural interpreter 130 ofremote processing system 104 via any appropriate data communicationmethod (e.g., wifi, G3/G4, IP enabled, etc.). In the exemplaryembodiment, pointing device 110 can be any device that can supportrunning a software application (e.g., resident application 112), that isa connected device (i.e., can pass or pass and receive data directly orindirectly to remote processing system 104), and has the ability tomeasure and report on its relative position, movement, or inclination.Although such position and movement sensors are generally well known inthe art, the sensors provided in pointing device 110 may include atleast one of: an accelerometer, a touch sensor, a gyroscope, amagnetometer, an optical sensor, an inertial tracker and the like.Furthermore, position, movement and user input data can also begenerated with a touch screen, mouse ball or the like on pointing device110. Such data can be generated independently or concurrently with theposition and movement sensors. Specific examples of pointing devices 110can be an iPhone® or an Android® phone or the like, although it shouldbe understood that the system and method described herein is in no wayintended to be limited to these particular data communication devices.Additionally, pointing device 110 can be provided with the ability toinput data (e.g., “clicks” or alphanumeric key presses), as well as areceiver capable of receiving feedback from remote processing system104.

As further shown in FIG. 1, user location 102 comprises viewing device120 that is connected to a video and audio content delivery system(e.g., IP data stream) and is capable of displaying a video feed and/oran application. It should be understood that viewing device 120 can beany suitably appropriate device capable of viewing a videofeed/application, including, but not limited to, a computer, PDA, laptopcomputer, notebook computer, television, viewing device with a set-topbox type processor (internal or external to the viewing device), aBlu-ray player, a video game console (internal or external to atelevision or the like), or any other device that can receive, send, andstore data and display video content on a screen. The present systemcontemplates (as will be discussed in detail below) that after a seriesof calibration and integration steps, system 100 can create aninteractive and responsive environment between pointing device 110 andviewing device 120 such that pointing device 110 can manipulate and/ornavigate the content displayed on viewing device 120 via a modifiedvideo feed and/or application.

As mentioned above, system 100 of FIG. 1 further comprises remoteprocessing system 104. As shown, remote processing system 104 includesgestural interpreter 130, gestural mark-up language processor 140(hereinafter “GML processor 140”), a secondary processing system 150, anoverlay engine 160, a video integration/enhancement processor 170, avideo source 180, and a distribution server 190. In general, remoteprocessing system 104, through various interaction of the componentsthat will be described in detail below, is capable through a series ofcalibration points, calculations, clicks, and cycles, to establish theposition of pointing device 110 relative to viewing device 120. Usingthis relative location, remote processing system 104 can then create anelectronic pointer and integrate the electronic pointer with a videofeed before the video feed is subsequently transmitted to viewing device120. The electronic pointer is integrated with the video feed such thatthe screen of viewing device 120 displays the modified video feed withthe electronic pointer in a location of the screen that reflects therelative position of the pointing device. Moreover, system 100 employs afeedback loop that constantly updates the on-screen pointer location inreaction to gestural movements of the pointing device.

Specifically, with reference to the components of remote processingsystem 104, gestural interpreter 130 is a system that includes areceiver configured to receive position and movement data from residentapplication 112 of pointing device 110, in which the position datarelates to the movement and relative position of pointing device 110 andis generated by the applicable sensors and/or user inputs on pointingdevice 110. As discussed above, it is noted that while position data isrelated to the physical position and movement of pointing device 110 inthe preferred embodiment, the position data could also relate to theposition as indicated on a touch screen of pointing device 110 in analternative embodiment. In that embodiment, a user is able to manipulatethe location of the electronic pointer using the touch screen as opposedto actually moving pointing device 110. Furthermore, as noted above,both types of data can be generated by pointing device 110 and processedat remote processing system 104 accordingly.

In addition, gestural interpreter 130 can include a transmitter that isconfigured to transmit feedback data to pointing device 110. Thisfeedback data can be in response to the user's movement of pointingdevice 110 as well as the various inputs selected by the user viapointing device 110. For example, if a user moves pointing device 110 toa position that would correspond to a location that is outside theboundary of the screen of viewing device 120, feedback data may beprovided by gestural interpreter 130 to pointing device 110 that cancause pointing device 110 to vibrate to serve as an indication that theuser has moved outside the boundary of the video screen.

Furthermore, as shown in FIG. 1, gestural interpreter 130 iscommunicatively coupled to GML processor 140 and overlay engine 160 andis configured to provide the data relating to the pointing indicatorlocation and/or motion information to these respective components. GMLprocessor 140 can serve as an intermediary and translator between thegestural interpreter 130 and other secondary processor systems (e.g.,secondary processing system 150) passing the relevant data in bothdirections. Secondary processing system 150 can be associated and/orprovided by a product supply server, such as HSN Shop By Remote®. Asnoted above, examples of product supply servers and their interactionwith content providers and remote user locations are described in U.S.Pat. No. 7,752,083. As further shown in FIG. 1, secondary processingsystem 150 is communicatively coupled to GML processor 140 and overlayengine 160. Secondary processing system 150 can contain softwareprograms/logic that use data from GML processor 140 to create responsedata, which is in turn passed to overlay engine 160. In addition,secondary processing system 150 is configured to pass data back throughGML processor 140, gestural interpreter 130, and/or pointing device 110.For example, based on a user's input to pointing device 110, secondaryprocessing system 150 can generate response data that is ultimately usedto generate the feedback data (discussed above) that is provided topointing device 110.

Overlay engine 160 is a processor that is configured to integrate theresponse data from secondary processing system 150 and the positionalinformation from pointing device 110 to generate a dataset that can berendered on a specific location on the video stream. This data set isthen provided to a video integration/enhancement processor 170 that isconfigured to render the data from overlay engine 160 into the videofeed provided by video source 180, creating a new integrated videostream. In one aspect of this embodiment, data can be rendered into anapplication provided by secondary processing system 150. In addition,video source 180 can be a content provider, such as that discussed aboveas well as with reference to U.S. Pat. No. 7,752,083, that is generatedfor one or more users.

The new integrated video stream (i.e., the video feed integrated withthe electronic pointer) is delivered to the distribution server 190,which, in turn, is configured to transmit the new integrated videostream to viewing device 120 that is associated with the pointing device110. The new integrated video stream can be transmitted to viewingdevice 120 using any appropriate data communication method (e.g., wifi,G3/G4, IP enabled, etc.). Viewing device 120 is, in turn, configured todisplay the integrated video stream on a screen. While the exemplaryembodiment contemplates that the video pointer is displayed when it isintegrated with the video feed, it should be understood that in onerefinement, the video pointer can be invisible. That is, the position,movement and/or user selection data is all machine recognized, (i.e.,processed to generate the video pointer and integrated with the videofeed), but the actual video pointer is not displayed on the screen.Thus, a user can still move the pointer within the video feed and makedesired selections. In this refinement, it is further contemplated thatas the user moves the video pointer to specific locations on the videofeed that are selectable (e.g., a user input to make a purchase), thatlocation is highlighted on the screen.

It should be understood that while the various components are describedto be part of remote processing system 104, it is in no way intendedthat these components all be located at the same physical location. Forexample, secondary processing system 150 and overlay engine 160 may belocated at a product supply server location whereas video source 180 anddistribution server 190 may be located at a content provider.

Once the electronic pointer is initially integrated on the video feedand/or application, a feedback loop is created using the foregoingcomponents that constantly updates the on-screen pointer location inreaction to the user's gestural movements of pointing device 110 and/ortouch screen inputs. As discussed in detail above, if the individualpoints to and “clicks” on various screen locations, these locations andclicks are interpreted by GML processor 140, which can then pass therelated action or data requests to secondary processing system 150 andassociated video processing logic. In turn, the results or responsesfrom secondary processing system 150 are delivered to overlay engine160, and the new content is dynamically integrated into the video streamand delivered back to the viewing device 120.

It is further noted that while each of the components described inremote processing system 104 is provided with one or more specificfunctions, each component is by no means intended to be limited to thesefunctions. For example, different components can provide differentprocessing functions within the context of the invention and/or a singlecomponent can perform both those functions described above with respectto the exemplary embodiment as well as other function performed bydifferent components as described above with respect to the exemplaryembodiment.

Finally, it should be understood that each of the aforementionedcomponents of remote processing system 104 comprise all requisitehardware and software modules to enable communication between each ofthe other respective components. These hardware components can includeconventional I/O interfaces, such as modems, network cards, and thelike. Such hardware components and software applications are known tothose skilled in the art and have not been described in detail so as notto unnecessarily obscure the description of the invention herein.Moreover, program instructions for each of the components can be in anysuitable form. In particular, some or all of the instructions may beprovided in programs written in a self-describing computer language,e.g., Hyper Text Markup Language (HTML), eXtensible Markup Language(XML) or the like. Transmitted program instructions may be used incombination with other previously installed instructions, e.g., forcontrolling a manner of display of data items described in a receivedprogram markup sheet.

FIG. 2 illustrates block diagram of a system 200 for integrating anelectronic pointer into a video feed in accordance with anotherexemplary embodiment. As shown, system 200 comprises substantiallysimilar components as those described above with respect to FIG. 1. Forexample, system 200 is generally divided into a user location 202 and aremote processing system 204. In addition, pointing device 210 withresident application 212 is provided at user location 202 as well asviewing device 220 similar to that described above with respect toFIG. 1. Pointing device 210 and resident application 212 are configuredto perform substantially the same functions as those discussed abovewith respect to pointing device 110 and resident application 112,respectively, of FIG. 1. Moreover, similar to FIG. 1, remote processingsystem 204 comprises gestural interpreter 230, GML processor 240,secondary processing system 250, overlay engine 260, video source 280and distribution server 290. In this exemplary embodiment, each of thesecomponents are provided to perform substantially the same functions asthose discussed above with regard to the respective components shown inFIG. 1.

As discussed above with respect to viewing device 120 of FIG. 1, viewingdevice 220 comprises a video screen capable of displaying a video feedand/or application from an outside source (e.g., video source 280).However, in the exemplary embodiment illustrated in FIG. 2, viewingdevice 220 further comprises local processor 222 and secondaryapplication 224. Essentially, with these components, the embodiment ofFIG. 2 is similar to the exemplary embodiment of FIG. 1, except that thevideo feed is delivered directly to viewing device 220, and moreparticularly, local processor 222. Local processor 222 is configured tointegrate the video source 280 (e.g., standard broadcast, DBS, cabledelivered video or the like) with the electronic pointer and relatedcontent from distribution server 290 onto the screen of viewing device220, effectively rendering a combined new video content stream onviewing device 220. Moreover, secondary application 224 is anapplication provided by (or associated with) secondary processing system250 that enables the specific interaction between the pointing deviceand the application provided by secondary processing system 250. Anexample of such a secondary application is HSN's point and shop featuresdiscussed in U.S. Provisional Patent Application No. 61/433,755 toMcDevitt, filed on Jan. 18, 2011, and entitled “SYSTEM AND METHOD FORRECOGNITION OF ITEMS IN ELECTRONIC MEDIA DATA AND DELIVERY OFINFORMATION RELATED THERETO,” which is hereby incorporated in itsentirety by reference thereto. It is noted that while local processor222 is described in the exemplary embodiment as integrated into viewingdevice 220, it should be understood to those skilled in the art thatlocal processor 222 can also be provided as a “stand-alone” component.

FIG. 3 illustrates block diagram of a system 300 for integrating anelectronic pointer into a video feed and/or application in accordancewith yet another exemplary embodiment. As shown, system 300 comprisessubstantially similar components as those described above with respectto FIGS. 1 and 2. For example, system 300 is generally divided into auser location 302 and a remote processing system 304. In addition,pointing device 310 with resident application 312 is provided at userlocation 302 as well as viewing device 320 similar to that describedabove with respect to FIGS. 1 and 2. Pointing device 310 and residentapplication 312 are configured to perform substantially the samefunctions as those discussed above with respect to the respectivepointing devices 110, 210 and resident applications 112, 212 of FIGS. 1and 2, respectively. Moreover, similar to FIGS. 1 and 2, remoteprocessing system 304 comprises gestural interpreter 330, GML processor340, secondary processing system 350, overlay engine 360, video source380 and distribution server 390. In this exemplary embodiment, each ofthese components are provided to perform substantially the samefunctions as those discussed above with regard to the respectivecomponents shown in FIGS. 1 and 2, respectively.

The primary distinction between the exemplary embodiments of FIGS. 1 and2 and the embodiment of FIG. 3 is that pointing device 310communications directly with viewing device 320 via a Wifi connection orthe like, instead of communicating directly to remote processing system304. In turn, viewing device 320 is configured to communicate remotelywith remote processing system 304, and, specifically, to transmitposition data to gestural interpreter 330 and receive feedback data fromgestural interpreter 330. Otherwise, the functionality of the system 300is generally the same as systems 100 and 200 of FIGS. 1 and 2,respectively. In other words, local processor 322 is configured tointegrate an electronic pointer with a video feed or an application suchthat the screen of viewing device 320 displays the modified video feedor application with the electronic pointer in a location of the screenthat reflects the relative position of the pointing device. Also,similar to secondary application 224 discussed above, secondaryapplication 324 can be provided (or associated with) secondaryprocessing system 350 that enables the specific interaction between thepointing device 310 and the application provided by secondary processingsystem 350.

Referring now to FIG. 4, a flowchart for a method for integrating anelectronic pointer into a video feed and/or application in accordancewith an exemplary embodiment. The following method is described withrespect to the components of FIG. 1 and their associated functionalityas discussed above. As shown in FIG. 4, initially, at step 405, pointingdevice 110 is synchronized with viewing device 120. This synchronizationcan be performed by the user who can initiate an application on pointingdevice 110 which in turn communicates this information to remoteprocessing system 104. The IP address of pointing device 110 can then bematched to the known IP address of viewing device 120 such that remoteprocessing system 104 recognizes that the user of pointing device 110 iscurrently attempting to interact with viewing device 120 via themovement and inputs of pointing device 110. It should be appreciatedthat while the synchronization step is described with respect to theassociation of IP addresses, similar techniques as known to thoseskilled in the art can be used to synchronize pointing device 110 andviewing device 120.

Next, at step 410, pointing device 110 collects movement andlocation/position data using various sensors, such as an accelerometer,gyroscope and the like, as described above. This data is thentransmitted as position data to gestural interpreter 130 (step 415). Inturn, gestural interpreter 130 processes the position data relating topointing device 110 and passes the information to GML processor 140(step 420). GML processor 140 serves as an intermediary and translatorbetween the gestural interpreter 130 and other secondary processorsystems (e.g., secondary processing system 150) passing the relevantdata in both directions (step 425).

Next, at step 430, secondary processing system 150 creates response dataemploying software programs/logic, which is in turn passed to overlayengine 160. In one aspect of this embodiment, secondary processingsystem 150 optionally passes feedback data back to pointing device 110(step 435). At step 440, overlay engine 160 processes the response datafrom secondary processing system 150 and the positional information frompointing device 110, via gestural interpreter 130 to generate a datasetthat can be rendered on a specific location on the video stream. Thisdata set is then provided to a video integration/enhancement processor170 that renders the data into the video feed and/or application tocreate a new integrated video stream (step 445). Next, at step 450, thisnew integrated video stream is then transmitted by distribution server190 to viewing device 120 that is associated with the pointing device110, as a result of the synchronization step 405. As a result, the userof pointing device 110 is provided with a video feed and/or applicationon viewing device 120 that includes an electronic pointer that can becontrolled by the user to navigate the video feed and/or application byentering inputs via pointing device 120.

Step 455 reflects the feedback loop associated with system 100 asdiscussed above. Each time the user moves pointing device 110 or makesan input using a “click” input or otherwise, this data is transmitted toremote processing system 104. Steps 410-450 are then repeated and themovement/input is reflected on the screen of viewing device 120. Forexample, any movement of pointing device 110 would be reflected as acorresponding movement of the electronic pointer on the screen ofviewing device 120.

It should be understood that while the method illustrated in FIG. 4corresponds to system 100 described in FIG. 1, similar such processingcan be performed with respect to the systems 200 and 300 described abovewith respect to FIGS. 2 and 3, respectively. The main difference, whichshould be understood to those skilled in the art of data communicationand data information processing, is where certain steps of theprocessing are performed and where the relevant data is transmittedbased on these different infrastructures. For example, referring to FIG.2, if viewing device 220 is a computer with a complex processor, e.g.,local processor 222, then the integration step (step 445) can beperformed at the viewing device 220 rather video integration/enhancementprocessor 170 of remote processing system 104 of FIG. 1. However, theother processing steps can still be performed by remote processingsystem 204. Accordingly, it should be understood to those skilled in theart that methods similar to that described above with respect to FIG. 4can be modified to reflect the infrastructure of the systems illustratedin FIGS. 2 and 3.

Finally, it is noted that while the method has been described mainlywith regard to the movement of pointing device 110, it is alsocontemplated that the control of the electronic pointer can be based ona user's manipulation of a touch screen of pointing device 110. As such,position data can be determined by the user's input via the touch screenand transmitted to the remote processing system 104 accordingly.Otherwise, the position data is processed using substantially similartechniques as those discussed above. Further, the method in FIG. 4 canequally be applied to this embodiment of the disclosed system.

While the foregoing has been described in conjunction with exemplaryembodiments, it is understood that the term “exemplary” is merely meantas an example. Accordingly, the application is intended to coveralternatives, modifications and equivalents, which may be includedwithin the spirit and scope of the system and method for integrating anelectronic pointing device in a video feed as disclosed herein.

Additionally, in the preceding detailed description, numerous specificdetails have been set forth in order to provide a thorough understandingof the present invention. However, it should be apparent to one ofordinary skill in the art that the system and method for integrating anelectronic pointing device in a video feed may be practiced withoutthese specific details. In other instances, well-known methods,procedures, components, and circuits have not been described in detailso as not to unnecessarily obscure aspects of the system and methoddisclosed herein.

What is claimed is:
 1. A system for creating an integrated video streambased on relative location and movement of a wireless pointing device,the system comprising: a receiver configured to continuously receiveposition data from a wireless pointing device; at least one processorconfigured to: calculate an initial position and orientation of thewireless pointing device based on the position data received from thewireless pointing device, access additional data from a secondary sourcebased on input data received from the wireless pointing device, andcreate the integrated video stream based on an original video stream,the initial position and orientation of the wireless pointing device andthe additional data accessed from the secondary source; and at least oneserver configured to transmit the integrated video stream to thewireless pointing device to be rendered on a screen thereof.
 2. Thesystem of claim 1, wherein the at least one server is further configuredto transmit feedback data to the wireless pointing device, in which thefeedback data is generated in response to the position data.
 3. Thesystem of claim 1, further comprising a feedback loop configured toadjust the integrated video stream based on a change in at least one ofthe initial position and orientation of the wireless pointing device. 4.The system of claim 1, wherein the position data is determined by auser's input on a touch screen of the wireless pointing device.
 5. Thesystem of claim 1, wherein the position data is measured by at least oneof an accelerometer, a gyroscope, a magnetometer, an optical sensor, andan inertial tracker.
 6. A method for creating an integrated video streambased on relative location and movement of a wireless pointing device,the method comprising: continuously receiving position data from awireless pointing device; calculating, by at least one processor, aninitial position and orientation of the wireless pointing device basedon the position data received from the wireless pointing device;accessing, by the at least one processor, additional data from asecondary source based on input data received from the wireless pointingdevice; creating, by the at least one processor, the integrated videostream based on an original video stream, the initial position andorientation of the wireless pointing device and the additional dataaccessed from the secondary processing system; and transmitting, by atleast one server, the integrated video stream to the wireless pointingdevice to be rendered on a screen thereof.
 7. The method of claim 6,further comprising transmitting, by the at least one server, feedbackdata to the wireless pointing device, in which the feedback data isgenerated in response to the position data.
 8. The method of claim 6,further comprising adjusting, using a feedback loop, the integratedvideo stream based on a change in at least one of the initial positionand orientation of the wireless pointing device.
 9. The method of claim6, further comprising determining, by the at least one processor, theposition data by a user's input on a touch screen of the wirelesspointing device.
 10. The method of claim 6, further comprisingmeasuring, by the wireless pointing device, the position data by atleast one of an accelerometer, a gyroscope, a magnetometer, an opticalsensor, and an inertial tracker.